Image processing apparatus

ABSTRACT

An image processing apparatus includes a fetcher. A fetcher fetches an object scene image. A first adjuster adjusts a tonality of the object scene image fetched by the fetcher, corresponding to a property of a display device. An object scene image outputter outputs the object scene image having the tonality adjusted by the first adjuster, toward the display device. A second adjuster adjusts the tonality of the object scene image fetched by the fetcher, in parallel with the adjusting process of the first adjuster. A first searcher searches for an object image that coincides with a registered object image from the object scene image having the tonality adjusted by the second adjuster.

CROSS REFERENCE OF RELATED APPLICATION

The disclosure of Japanese Patent Application No. 2009-218487, which wasfiled on Sep. 24, 2009, is incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing apparatus. Moreparticularly, the present invention relates to an image processingapparatus which is applied to a digital camera and which searches for anobject image that coincides with a registered object image from anobject scene image.

2. Description of the Related Art

According to one example of this type of apparatus, a human-regiondetecting section detects a face region of a human existing in a regionto be photographed by referring to an image inputted from an image inputsection. Moreover, a brightness-variation-region detecting sectiondivides the image inputted from the image input section into localregions, and evaluates a distribution of a temporal change of brightnessinformation in each of the local regions. An input control sectioncontrols an input-image adjustment element based on detection results ofthese detecting sections.

On the other hand, a human-feature extracting section extracts featureinformation of the face of the human from the face region detected bythe human-region detecting section. A recognizing section checks theextracted feature information of the face of the human withpreviously-registered feature information of a face of a human so as torecognize the human existing within the region to be photographed.

However, in the above-described apparatus, a common input image having aquality that follows the input-image adjustment element is referred toin each of the input control section and the recognizing section. Thus,depending on a color of the face of the human, there is a possibilitythat either one of a performance of reproducing the face image or aperformance of searching for the face image is deteriorated.

SUMMARY OF THE INVENTION

An image processing apparatus according to the present inventioncomprises: a fetcher which fetches an object scene image; a firstadjuster which adjusts atonality of the object scene image fetched bythe fetcher, corresponding to a property of a display device; anobject-scene-image outputter which outputs the object scene image havingthe tonality adjusted by the first adjuster, toward the display device;a second adjuster which adjusts the tonality of the object scene imagefetched by the fetcher, in parallel with the adjusting process of thefirst adjuster; and a first searcher which searches for an object imagethat coincides with a registered object image from the object sceneimage having the tonality adjusted by the second adjuster.

The above described features and advantages of the present inventionwill become more apparent from the following detailed description of theembodiment when taken in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a basic configuration of oneembodiment of the present invention;

FIG. 2 is a block diagram showing a configuration of one embodiment ofthe present invention;

FIG. 3 is an illustrative view showing one example of a state where anevaluation area is allocated to an imaging surface;

FIG. 4 is a block diagram showing one example of a configuration of apost-processing circuit applied to the embodiment in FIG. 2;

FIG. 5 is an illustrative view showing one example of a configuration ofa register referred to in contrast adjusting behavior;

FIG. 6 is an illustrative view showing one example of a configuration ofan extraction dictionary;

FIG. 7 is an illustrative view showing one example of a registerreferred to in face detecting behavior;

FIG. 8 is an illustrative view showing one example of a face-detectionframe structure used for a face recognizing process;

FIG. 9 is an illustrative view showing one portion of the face detectingbehavior;

FIG. 10(A) is an illustrative view showing one example of a displayimage;

FIG. 10(B) is an illustrative view showing one example of a searchimage;

FIG. 11(A) is an illustrative view showing another example of thedisplay image;

FIG. 11(B) is an illustrative view showing another example of the searchimage;

FIG. 12(A) is an illustrative view showing one example of a reproducedimage;

FIG. 12(B) is an illustrative view showing one example of a reproducedimage on which a zoom process and a scroll process are performed;

FIG. 13 is an illustrative view showing one example of a configurationof a general dictionary;

FIG. 14 is a graph showing one example of a gamma correction curve;

FIG. 15 is an illustrative view showing one portion of contrastadjusting behavior;

FIG. 16(A) is an illustrative view showing one example of a temporaryregister referred to in extraction-dictionary creating behavior;

FIG. 16(B) is an illustrative view showing another example of thetemporary register referred to in the extraction-dictionary creatingbehavior;

FIG. 16(C) is an illustrative view showing still another example of thetemporary register referred to in the extraction-dictionary creatingbehavior;

FIG. 16(D) is an illustrative view showing yet another example of thetemporary register referred to in the extraction-dictionary creatingbehavior;

FIG. 17 is an illustrative view showing another example of theconfiguration of the extraction dictionary;

FIG. 18 is an illustrative view showing another example of theconfiguration of the register referred to in the contrast adjustingbehavior;

FIG. 19(A) is an illustrative view showing still another example of thedisplay image;

FIG. 19(B) is an illustrative view showing still another example of thesearch image;

FIG. 20 is a flowchart showing one portion of behavior of a CPU appliedto the embodiment in FIG. 2;

FIG. 21 is a flowchart showing another portion of the behavior of theCPU applied to the embodiment in FIG. 2;

FIG. 22 is a flowchart showing still another portion of the behavior ofthe CPU applied to the embodiment in FIG. 2;

FIG. 23 is a flowchart showing yet another portion of the behavior ofthe CPU applied to the embodiment in FIG. 2;

FIG. 24 is a flowchart showing another portion of the behavior of theCPU applied to the embodiment in FIG. 2;

FIG. 25 is a flowchart showing still another portion of the behavior ofthe CPU applied to the embodiment in FIG. 2;

FIG. 26 is a flowchart showing yet another portion of the behavior ofthe CPU applied to the embodiment in FIG. 2;

FIG. 27 is a flowchart showing another portion of the behavior of theCPU applied to the embodiment in FIG. 2;

FIG. 28 is a flowchart showing one portion of behavior of the CPUapplied to another embodiment;

FIG. 29 is a flowchart showing another portion of the behavior of theCPU applied to another embodiment;

FIG. 30 is a flowchart showing one portion of behavior of the CPUapplied to still another embodiment;

FIG. 31 is a flowchart showing one portion of behavior of the CPUapplied to yet another embodiment;

FIG. 32 is a flowchart showing one portion of behavior of the CPUapplied to another embodiment; and

FIG. 33 is an illustrative view showing one example of an inquiry screendisplayed in another embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

With reference to FIG. 1, an image processing apparatus of oneembodiment of the present invention is basically configured as follows:A fetcher 1 fetches an object scene image. A first adjuster 2 adjusts atonality of the object scene image fetched by the fetcher 1,corresponding to a property of a display device 6. An object scene imageoutputter 3 outputs the object scene image having the tonality adjustedby the first adjuster 2, toward the display device 6. A second adjuster4 adjusts the tonality of the object scene image fetched by the fetcher1, in parallel with the adjusting process of the first adjuster 2. Afirst searcher 5 searches for an object image that coincides with aregistered object image from the object scene image having the tonalityadjusted by the second adjuster 4.

Therefore, the tonality of the object scene image outputted toward thedisplay device 6 is adjusted corresponding to the property of thedisplay device 6 while the object scene image that is a subject to besearched of the object image that coincides with the registered objectimage is adjusted irrespective of the property of the display device 6.This enables improvement of both a performance of reproducing the objectimage that coincides with the registered object image and a performanceof searching for the same.

With reference to FIG. 2, a digital camera 10 according to thisembodiment includes a focus lens 12 and an aperture unit 14 respectivelydriven by drivers 18 a and 18 b. An optical image of an object scenethat undergoes these components enters, with irradiation, an imagingsurface of an imager 16, and is subjected to a photoelectric conversion.Thereby, electric charges representing an object scene image areproduced.

When a power source is applied, a CPU 26 determines under a main task asetting (i.e., an operation mode at a current time point) of a modeselector switch 28 md arranged in a key input device 28. If theoperation mode at a current time point is a camera mode, then an imagingtask and a face detecting task are started up, and if the operation modeat the current time point is a reproduction mode, then a reproducingtask is started up.

When the imaging task is started up, the CPU 26 commands a driver 18 cto repeat exposure behavior and electric-charge reading-out behavior inorder to start a moving-image fetching process. In response to avertical synchronization signal Vsync periodically generated from aSignal Generator (SG) not shown, the driver 18 c exposes the imagingsurface and reads out the electric charges produced on the imagingsurface in a raster scanning manner. From the imager 16, raw image databased on the read-out electric charges is cyclically outputted.

A pre-processing circuit 20 performs processes, such as digital clamp,pixel defect correction, and gain control, on the raw image dataoutputted from the imager 16. The raw image data on which theseprocesses are performed is written into a raw image area 32 a of anSDRAM 32 through a memory control circuit 30.

A post-processing circuit 34 reads out the raw image data accommodatedin the raw image area 32 a through the memory control circuit 30,performs a color separation process and a white balance adjustingprocess on the read-out raw image data, and performs a gamma correctingprocess and a YUV converting process which are for display-use, and agamma correcting process and a YUV converting process which are forsearch-use, individually on the image data having the adjusted whitebalance. Thereby, display image data and search image data that complywith a YUV format are individually created.

The display image data is written into a display image area 32 b of theSDRAM 32 by the memory control circuit 30. The search image data iswritten into a search image area 32 c of the SDRAM 32 by the memorycontrol circuit 30.

An LCD driver 36 repeatedly reads out the display image dataaccommodated in the display image area 32 b through the memory controlcircuit 30, and drives an LCD monitor 38 based on the read-out imagedata. As a result, a real-time moving image (through image) of theobject scene is displayed on a monitor screen. It is noted that aprocess on the search image data will be described later.

With reference to FIG. 3, an evaluation area EVA is allocated to acenter of the imaging surface. The evaluation area EVA is divided into16 portions in each of a horizontal direction and a vertical direction;therefore, 256 divided areas form the evaluation area EVA. Moreover, inaddition to the above-described processes, the pre-processing circuit 20executes a simple RGB converting process for simply converting the rawimage data into RGB data.

An AE evaluating circuit 22 integrates RGB data belonging to theevaluation area EVA, out of the RGB data produced by the pre-processingcircuit 20, at each generation of the vertical synchronization signalVsync. Thereby, 256 integral values, i.e., 256 AE evaluation values, areoutputted from the AE evaluating circuit 22 in response to the verticalsynchronization signal Vsync.

Moreover, an AF evaluating circuit 24 extracts a high-frequencycomponent of G data belonging to the same evaluation area EVA, out ofthe RGB data outputted from the pre-processing circuit 20, andintegrates the extracted high-frequency component at each generation ofthe vertical synchronization signal Vsync. Thereby, 256 integral values,i.e., 256 AF evaluation values, are outputted from the AF evaluatingcircuit 24 in response to the vertical synchronization signal Vsync.

The CPU 26 executes a simple AE process that is based on the output fromthe AE evaluating circuit 22, in parallel with a moving-image fetchingprocess, so as to calculate an appropriate EV value. An aperture amountand an exposure time period that define the calculated appropriate EVvalue are set to the drivers 18 b and 18 c, respectively. As a result, abrightness of the through image is adjusted moderately.

When a shutter button 28 sh is half-depressed, the CPU 26 executes an AEprocess based on the output of the AE evaluating circuit 22 so as tocalculate an optimal EV value. Similarly to the above-described case, anaperture amount and an exposure time period that define the calculatedoptimal EV value are set to the drivers 18 b and 18 c, respectively. Asa result, the brightness of the through image is adjusted strictly.Moreover, the CPU 26 executes an AF process that is based on the outputfrom the AF evaluating circuit 24. The focus lens 12 is set to a focalpoint by the driver 18 a, and thereby, a sharpness of the through imageis improved.

When the shutter button 28 sh is fully depressed, the CPU 26 starts upan I/F 40 for a recording process. The I/F 40 reads out one frame of thedisplay image data representing an object scene that is obtained at atime point at which the shutter button 28 sh is fully depressed, fromthe display image area 32 b through the memory control circuit 30, andrecords an image file in which the read-out display image data iscontained onto a recording medium 42.

The post-processing circuit 34 is configured as shown in FIG. 4. The rawimage data read-out by the memory control circuit 30 is subjected to acolor separation process by a color separation circuit 50, and a whitebalance of the color-separated image data is adjusted by a white-balanceadjusting circuit 52. The image data having the adjusted white balanceis applied to gamma correcting circuits 54 and 58.

The gamma correcting circuit 54 adjusts a contrast of the image dataaccording to a gamma correction curve that corresponds to a property(color reproducibility) of the LCD monitor 38. The image data having theadjusted contrast undergoes a YUV converting process by the YUVconverting circuit 56, and then, is outputted as the display image data.

On a register RGST1, any one of gamma correction curves CV_0 to CV_3(details will be described later) shown in FIG. 14 is registered asshown in FIG. 5. The gamma correcting circuit 58 adjusts a contrast ofthe image data according to the gamma correction curve accommodated onthe register RGST1. The image data having the adjusted contrastundergoes a YUV converting process by a YUV converting circuit 60, andthen, is outputted as the search image data.

Under the face detecting task executed in parallel with the imagingtask, the CPU 26 repeatedly searches for a face image of an animal fromthe image data accommodated in the search image area 32 c. For such aface detecting task, an extraction dictionary EXDC shown in FIG. 6, aregister RGST2 shown in FIG. 7, and a plurality of face-detection framestructures FD, FD, FD, . . . shown in FIG. 8 are prepared.

According to FIG. 6, a characteristic of a face of an Egyptian Mau,which is one of the species of cats, is contained as a face pattern FP_1in the extraction dictionary EXDC, and a characteristic of a face of anAmerican Short Hair, which is another one of the species of cats, iscontained as a face pattern FP_2 in the extraction dictionary EXDC. Itis noted that in FIG. 6, English words of “Egyptian Mau” and those of“American Short Hair” are described. In reality, however, thecharacteristic of the face of the Egyptian Mau and that of the face ofthe American Short Hair are registered.

Furthermore, the register RGST2 shown in FIG. 7 is equivalent to aregister used for describing a face-frame-structure information, and isformed by: a column in which a position of the detected face image(position of the face-detection frame structure FD at a time point atwhich the face image is detected) is described; and a column in which asize of the detected face image (size of the face-detection framestructure FD at a time point at which the face image is detected) isdescribed.

Moreover, the face-detection frame structure FD shown in FIG. 8 moves ina raster scanning manner on the search image area 32 c corresponding tothe evaluation area EVA shown in FIG. 9 at each generation of thevertical synchronization signal Vsync. The size of the face-detectionframe structure FD is reduced by a scale of “5” from “200” to “20” ateach time that raster scanning is ended.

The CPU 26 reads out the image data belonging to the face-detectionframe structure FD from the search image area 32 c through the memorycontrol circuit 30 so as to calculate a characteristic amount of theread-out image data. The calculated characteristic amount is checkedwith each of the face patterns FP_1 to FP_2 contained in the extractiondictionary EXDC. When a checking degree exceeds a threshold value TH,the position and the size of the face-detection frame structure FD atthe current time point are registered, as face-frame-structureinformation, onto the register RGST2.

When the raster scanning of the face-detection frame structure FD of aminimum size (=20) is ended, the CPU 26 detects the face-frame-structureinformation registered on the register RGST2, and issues aface-frame-structure character display command corresponding to thedetected face-frame-structure information toward a graphic generator 46.However, in a case where there is no face-frame-structure information onthe register RGST2, the issuance of the face-frame-structure characterdisplay command is cancelled.

The graphic generator 46 creates graphic image data representing a faceframe structure, based on the applied face-frame-structure characterdisplay command, and applies the created graphic image data to the LCDdriver 36. The LCD driver 36 displays a face-frame-structure characterKF1 on the LCD monitor 38, based on the applied graphic image data.

When the Egyptian Mau EM1 is captured on the imaging surface, displayimage data shown in FIG. 10(A) and search image data shown in FIG. 10(B)are created in parallel to each other. The display image data issubjected to a display process by the LCD driver 36, and the searchimage data is subjected to a face detecting process by the CPU 26.

As a result of the face detecting process, the checking degree betweenthe characteristic of the face image of the Egyptian Mau EM1 and theface pattern FP_1 shown in FIG. 6 exceeds the threshold value TH. Theface-frame-structure character KF1 is displayed on the LCD monitor 38 ina manner to surround the face image of the Egyptian Mau EM1 (see FIG.10(A)).

On the other hand, when the Siberian Husky SH1 is captured on theimaging surface, display image data shown in FIG. 11(A) and search imagedata shown in FIG. 11(B) are created in parallel to each other. Asdescribed above, the display image data is subjected to the displayprocess by the LCD driver 36, and the search image data is subjected tothe face detecting process by the CPU 26.

However, both the checking degrees between the characteristic of theface image of the Siberian Husky SH1 and each of the face patterns FP_1and FP_2 shown in FIG. 6 fall below the threshold value TH. Therefore,the face-frame-structure character KF1 is to be non-displayed (see FIG.11(A)).

When the face-frame-structure character KF1 is displayed, theabove-described AE process and AF process are executed by noticing theimage within the face-frame-structure character KF1. On the other hand,when the face-frame-structure character KF is non-displayed, theabove-described AE process and AF process are executed by noticing thewhole image of the evaluation area EVA. Thus, imaging parameters such asan exposure amount and a focus are satisfactorily adjusted.

When the reproducing task is started up, the CPU 26 designates thelatest image file recorded on the recording medium 42, as areproduced-image file, and commands the FE 40 and the LCD driver 36 toexecute a reproducing process in which the designated image file isnoticed.

The I/F 40 reads out the image data of the designated image file fromthe recording medium 42, and writes the read-out image data into thedisplay image area 32 b of the SDRAM 32 through the memory controlcircuit 30.

The LCD driver 36 reads out the image data accommodated in the displayimage area 32 b through the memory control circuit 30, and drives theLCD monitor 38 based on the read-out image data. As a result, areproduced image based on the image data of the designated image file isdisplayed on the LCD monitor 38.

Following such a reproducing process, the CPU 26 issues aregistration-frame-structure character display command toward thegraphic generator 46. The graphic generator 46 creates graphic imagedata representing a registration frame structure, based on the appliedregistration-frame-structure character display command, and applies thecreated graphic image data to the LCD driver 36. The LCD driver 36displays the registration-frame-structure character RF1 at a center ofthe screen of the LCD monitor 38, based on the applied graphic imagedata.

Therefore, when the display image data shown in FIG. 11(A) is recordedonto the recording medium 42 in the camera mode and this display imagedata is reproduced from the recording medium 42 in the reproductionmode, the reproduced image and the registration-frame-structurecharacter RF1 are displayed on the LCD monitor 38 as shown in FIG.12(A).

When a forward/rewind button 28 fr of the key input device 28 ismanipulated, the CPU 26 designates a succeeding image file or apreceding image file as the reproduced-image file. The designated-imagefile is subjected to a reproducing process similar to that describedabove. As a result, the reproduced image is updated.

When a tele/wide button 28 tw of the key input device 28 is manipulated,the reproduced image displayed on the LCD monitor 38 is reduced orexpanded. Thereby, the magnification of the display image is changed.When a cross button 28 cs of the key input device 28 is manipulated, thereproduced image displayed on the LCD monitor 38 is scrolled. Thereby, aposition of the display image is changed.

Therefore, if the tele/wide button 28 tw and the cross button 28 cs aremanipulated in a state where a reproduced image shown in FIG. 12(A) isdisplayed, then the reproduced image is transitioned from FIG. 12(A) toFIG. 12(B), for example.

If a registration button 28 rg of the key input device 28 is manipulatedin a state where any one of the reproduced images is displayed, then inorder to register one portion of the face patterns FP_1 to FP_70contained in a general dictionary GLDC shown in FIG. 13 into theextraction dictionary EXDC, and in order to register any one of thegamma correction curves CV_0 to CV_3 shown in FIG. 14 onto the registerRGST1, an extracting process is executed as follows:

In the general dictionary GLDC shown in FIG. 13, face patterns FP_1 toFP_45 represent characteristics of faces of dogs of 45 species,respectively, face patterns FP_46 to FP_60 represent characteristics offaces of cats of 15 species, respectively, and face patterns FP_61 toFP_70 represent characteristics of faces of rabbits of 10 species,respectively.

Moreover, with reference to FIG. 14, a gamma value defining a curvatureof the gamma correction curve increases in the order of CV_0 to CV_1 toCV_2 to CV_3. Furthermore, the brightness of the image increases alongwith the increase in gamma value. Therefore, the brightness of the imageof the Siberian Husky SH1 on which the gamma correcting process has beenperformed changes as shown in FIG. 15 according to the curvature of thereferred gamma correction curve.

In the extracting process, firstly, a variable N is set to each of “0”to “3”, and the contrast of the display image data accommodated in thedisplay image area 32 b is adjusted with reference to the gammacorrection curve CV_N. Upon completion of the contrast adjustment, oneportion of the display image data belonging to theregistration-frame-structure character RF1 is read out from the displayimage area 32 b, and the characteristic amount of the read-out displayimage data is calculated.

The calculated characteristic amount is checked with each of the facepatterns FP_0 to FP_70 contained in the general dictionary GLDC.Together with the checking degree, the identification number of the facepattern of which the checking degree exceeds the threshold value TH isregistered onto temporary registers TMP_0 to TMP_3 shown in FIG. 16(A)to FIG. 16(D).

The identification numbers of the face pattern of which the checkingdegree exceeds the threshold value TH and the checking degrees areregistered onto the temporary register TMP_0 corresponding to thedisplay image data adjusted with reference to the gamma correction curveCV_0, registered onto the temporary register TMP_1 corresponding to thedisplay image data adjusted with reference to the gamma correction curveCV_1, registered onto the temporary register TMP_2 corresponding to thedisplay image data adjusted with reference to the gamma correction curveCV_2, and registered onto the temporary register TMP_3 corresponding tothe display image data adjusted with reference to the gamma correctioncurve CV_3.

Upon completion of the registering process on the temporary registersTMP_0 to TMP_3 in this way, a checking degree (maximum checking degree)indicating a maximum value is detected from the plurality of checkingdegrees registered on the temporary registers TMP_0 to TMP_3. Thetemporary register onto which the detected maximum checking degree isregistered is designated as a noticed temporary register. Then, the twoface patterns corresponding to the top two checking degrees registeredon the noticed temporary register are duplicated from the generaldictionary GLDC into the extraction dictionary EXDC.

Upon completion of the duplicating process, the gamma correction curvehaving the same identification number as the identification number ofthe noticed temporary register is registered onto the register RGST1.For example, if the noticed temporary register is “TMP_1”, then thegamma correction curve CV_1 is registered onto the register RGST1, andif the noticed temporary register is “TMP_3”, then the gamma correctioncurve CV_3 is registered onto the register RGST1.

The tonality of the image data applied to the gamma correcting circuit58 (see FIG. 4) in a subsequent camera mode is adjusted corresponding tothe tonalities of the face patterns FP_1 and FP_2 newly registered intothe extraction dictionary EXDC. Moreover, the search image dataoutputted from the YUV converting circuit 60 (see FIG. 4) is checkedwith the face patterns FP_1 and FP_2 newly registered into theextraction dictionary EXDC.

Therefore, if the extracting process is executed in a display stateshown in FIG. 12(B), the extraction dictionary EXDC is updated from astate shown in FIG. 6 to a state shown in FIG. 17, and the registerRGST1 is updated from a state shown in FIG. 5 to a state shown in FIG.18.

According to FIG. 17, the characteristic of the face of the SiberianHusky, which is one of the species of the dogs, is contained in theextraction dictionary EXDC as the face pattern FP_1, and acharacteristic of a face of an Alaskan Malamute, which is another one ofthe species of the dogs, is contained in the extraction dictionary EXDCas the face pattern FP_2. Furthermore, according to FIG. 18, the gammacorrection curve CV_3 is registered onto the register RGST1.

If the Siberian Husky SH1 is captured in a subsequent camera mode, thendisplay image data shown in FIG. 19(A) and search image data shown inFIG. 19(B) are created in parallel to each other. The display image datais subjected to a display process by the LCD driver 36, and the searchimage data is subjected to a face detecting process by the CPU 26.

As a result of the face detecting process, the checking degree betweenthe characteristic of the face image of the Siberian Husky SH1 and theface pattern FP_1 shown in FIG. 17 exceeds the threshold value TH. Theface-frame-structure character KF1 is displayed on the LCD monitor 38 ina manner to surround the face image of the Siberian Husky SH1 (see FIG.19(A)).

The CPU 26 executes a plurality of tasks including a main task shown inFIG. 20, an imaging task shown in FIG. 21, a face detecting task shownin FIG. 22 to FIG. 24, and a reproducing task shown in FIG. 25 to FIG.27, in a parallel manner. Control programs corresponding to these tasksare stored in a flash memory 44.

With reference to FIG. 20, in a step S1, it is determined whether or notthe operation mode at the current time point is the camera mode, and ina step S3, it is determined whether or not the operation mode at thecurrent time point is the reproduction mode. When YES is determined inthe step S1, the imaging task is started up in a step S5 and the facedetecting task is started up in a step S7. When YES is determined in thestep S3, the reproducing task is started up in a step S9. When NO isdetermined in both the steps S1 and S3, another process is executed in astep S11. Upon completion of the process in the step S7, S9, or S11, itis repeatedly determined in a step S13 whether or not a mode switchingmanipulation is performed. When a determined result is updated from NOto YES, the task that is being started up is stopped in a step S15.Thereafter, the process returns to the step S1.

With reference to FIG. 21, in a step S21, the moving-image fetchingprocess is executed. As a result, the through image representing theobject scene is displayed on the LCD monitor 38. In a step S23, it isdetermined whether or not the shutter button 28 sh is half-depressed,and as long as a determined result is NO, a simple AE process in a stepS25 is repeated. As a result, the brightness of the through image isadjusted moderately. When YES is determined in the step S23, the AEprocess is executed in a step S27 and the AF process is executed in astep S29. Thereby, the brightness and the focus of the through image arestrictly adjusted.

In a step S31, it is determined whether or not the shutter button 28 shis fully depressed. In a step S33, it is determined whether or not themanipulation of the shutter button 28 sh is canceled. When YES isdetermined in the step S31, the process advances to a step S35 so as toexecute the recording process, and thereafter, the process returns tothe step S23. When YES is determined in the step S33, the processdirectly returns to the step S23. As a result of the recording processin the step S35, the image data representing the object scene at thetime point at which the shutter button 28 sh is fully depressed isrecorded onto the recording medium 42 in a file format.

With reference to FIG. 22, in a step S41, it is determined whether ornot the vertical synchronization signal Vsync is generated. When adetermined result is updated from NO to YES, the size of theface-detection frame structure FD is set to “200” in a step S43, and theface-detection frame structure FD is placed at a starting position(upper left of the evaluation area EVA) in a step S45. In a step S47,one portion of the image data belonging to the face-detection framestructure FD is read out from the search image area 32 c, and thecharacteristic amount of the read-out image data is calculated.

In a step S49, a checking process for checking the calculatedcharacteristic amount with each of the face patterns FP_1 and FP_2contained in the extraction dictionary EXDC is executed. Upon completionof the checking process, it is determined in a step S51 whether or notthe face-detection frame structure FD reaches an ending position (lowerright of the evaluation area EVA).

When a determined result is NO, in a step S53, the face-detection framestructure FD is moved in a raster direction by a predetermined amount,and thereafter, the process returns to the step S47. When a determinedresult is YES, it is determined in a step S55 whether or not the size ofthe face-detection frame structure FD) is reduced to “20”. When thedetermined result is NO, the size of the face-detection frame structureFD is reduced by “5” in a step S57, and the face-detection framestructure is placed at a starting position in a step S59. Thereafter,the process returns to the step S47.

When a determined result in the step S55 is YES, the process advances toa step S61 so as to detect the face-frame-structure informationdescribed on the register RGST2 and issue the face-frame-structurecharacter display command corresponding to the detectedface-frame-structure information toward the graphic generator 46.However, in a case where there is no face-frame-structure information onthe register RGST2, the issuance of the face-frame-structure characterdisplay command is cancelled. As a result, the face-frame-structurecharacter KF1 is displayed on the through image in an OSD manner. Uponcompletion of the process in the step S61, the process returns to thestep S41.

The checking process in the step S49 shown in FIG. 23 is executedaccording to a subroutine shown in FIG. 24. Firstly, in a step S71, avariable L is set to “1”. In a step S73, the characteristic amount ofthe image data belonging to the face-detection frame structure FD ischecked with the face pattern FP_L contained in the extractiondictionary EXDC. In a step S75, it is determined whether or not thechecking degree exceeds the threshold value TH.

When the determined result is NO, the variable L is incremented in astep S79. In a step S81, it is determined whether or not the incrementedvariable L exceeds “2”. Then, when L≧2 is established, the processreturns to the step S73 while when L>2 is established, the process isrestored to the routine at an upper hierarchical level. When YES isdetermined in the step S75, the process advances to a step S77 so as todescribe the current position and the current size of the face-detectionframe structure FD, as the face-frame-structure information, onto theregister RGST2. Upon completion of the process in the step S77, theprocess is restored to the routine at an upper hierarchical level.

With reference to FIG. 25, in a step S91, the latest image file recordedon the recording medium 42 is designated, and in a step S93, thereproducing process in which the designated image file is noticed isexecuted. As a result, the display image data contained in thedesignated image file is transferred to the display image area 32 b ofthe SDRAM 32, and the reproduced image based on this display image datais displayed on the LCD monitor 38. In a step S95, theregistration-frame-structure character display command is issued towardthe graphic generator 46. As a result, the registration-frame-structurecharacter RF1 is displayed on the through image in an OSD manner.

In a step S97, it is determined whether or not the forward/rewind button28 fr is manipulated. In a step S103, it is determined whether or notthe tele/wide button 28 tw is manipulated. Moreover, in a step S107, itis determined whether or not the cross button 28 cs is manipulated, andin a step S111, it is determined whether or not the registration button28 rg is manipulated.

When a determined result in the step S97 is YES, the process advances toa step S99 so as to designate the succeeding image file or the precedingimage file as a subsequent reproduced-image file. Upon completion of theprocess in the step S99, a reproducing process similar to that describedabove is executed in a step S101. Thereafter, the process returns to thestep S97.

When a determined result in the step S103 is YES, the process advancesto a step S105 so as to reduce or expand the reproduced image displayedon the LCD monitor 38. Thereby, the magnification of the display imageis changed. Upon completion of the reducing/expanding process, theprocess returns to the step S97.

When a determined result in the step S107 is YES, the process advancesto a step S109 so as to scroll the reproduced image displayed on the LCDmonitor 38. Thereby, the position of the reproduced image to bedisplayed is changed. Upon completion of the scroll process, the processreturns to the step S97.

When YES is determined in the step S111, the process advances to a stepS113 so as to execute the extracting process for registering one portionof the face patterns FP_1 to FP_70 contained in the general dictionaryGLDC into the extraction dictionary EXDC. Upon completion of theextracting process, the process returns to the step S97.

The extracting process in the step S113 is executed according to asubroutine shown in FIG. 26. In a step S121, a variable N is set to “0”.In a step S123, the contrast of the display image data accommodated inthe display image area 32 b is adjusted with reference to the gammacorrection curve CV_N. In a step S125, one portion of the display imagedata belonging to the registration-frame-structure character RF1 is readout from the display image area 32 b, and the characteristic amount ofthe read-out display image data is calculated.

In a step S127, the variable L is set to “1”. In a step S129, thecharacteristic amount calculated in the step S125 is checked with theface pattern FP_L contained in the general dictionary GLDC. In a stepS131, it is determined whether or not the checking degree exceeds thethreshold value TH. When a determined result is NO, the process directlyadvances to a step S135 while when the determined result is YES, theprocess advances to the step S135 via a process in a step S133. In thestep S133, the identification number L and the checking degreeassociated with each other are registered onto the temporary registerTMP_N.

In the step S135, the variable L is incremented. In a step S137, it isdetermined whether or not the incremented variable L exceeds “70”equivalent to the number of the face patterns registered in the generaldictionary GLDC. When a determined result is NO, the process returns tothe step S129. When the determined result is YES, the process advancesto a step S141 after incrementing the variable N in a step S139. In thestep S141, it is determined whether or not the variable N exceeds “3”.When a determined result is NO, the process returns to the step S123while when the determined result is YES, the process advances to a stepS143.

In the step S143, the maximum checking degree is detected from among theplurality of checking degrees registered on the temporary registersTMP_0 to TMP_3, and the temporary register on which the detected maximumchecking degree is registered is designated as the noticed temporaryregister. In a step S145, the two face patterns corresponding to the toptwo checking degrees registered on the noticed temporary register aredetected from the general dictionary GLDC, and the detected facepatterns are registered in the extraction dictionary EXDC. In a stepS147, the gamma correction curve having the same identification numberas the identification number of the noticed temporary register isregistered onto the register RGST1. Upon completion of the process inthe step S147, the process is restored to the routine at an upperhierarchical level.

As can be seen from the above-described explanation, the object sceneimage is fetched by the memory control circuit 30 into the SDRAM 32. Thegamma correcting circuit 54 of the post-processing circuit 34 adjuststhe tonality of the object scene image fetched to the SDRAM 32,corresponding to the property of the LCD monitor 38. The object sceneimage having the adjusted tonality is displayed on the LCD monitor 38 bythe LCD driver 36. Furthermore, the gamma correcting circuit 58 arrangedin the post-processing circuit 34 adjusts the tonality of the objectscene image fetched to the SDRAM 32, corresponding to the tonality ofthe registered face pattern. Moreover, in parallel to each other, thegamma correcting circuits 54 and 58 execute the tonality adjustingprocess. The CPU 26 searches for the object image that coincides withthe registered face pattern from the object scene image having thetonality adjusted by the gamma correcting circuit 58 (S41 to S59).

Therefore, the tonality of the object scene image outputted toward theLCD monitor 38 is adjusted corresponding to the property of the LCDmonitor 38 while the object scene image that is a subject to be searchedof the object image that coincides with the registered face pattern isadjusted irrespective of the property of the LCD monitor 38. Thisenables improvement of both a performance of reproducing the objectimage that coincides with the registered face pattern and a performanceof searching for the same.

It is noted that in the extracting process according to this embodiment,the four searching processes (S125 to S137) respectively correspondingto the gamma correction curves CV_0 to CV_3 are to be executed. However,if the gamma correction curve is finalized before the searching process,then a single searching process may suffice.

In this case, the CPU 26 executes an extracting process shown in FIG. 28and FIG. 29, instead of the extracting process shown in FIG. 26 and FIG.27.

Firstly, in a step S151, a plurality of brightness respectivelycorresponding to a plurality of positions on the display image databelonging to the registration-frame-structure character RF1 aredetected. In a step S153, an average value of the plurality of detectedbrightness is calculated as “Yav”. In a step S155, it is determinedwhether or not the average value Yav exceeds a reference value Y0. In astep S157, it is determined whether or not the average value Yav exceedsa reference value Y1. In a step S159, it is determined whether or notthe average value Yav exceeds a reference value Y2. It is noted thatamong the reference values Y0 to Y2, a relationship of Y0>Y1>Y2 isestablished.

When YES is determined in the step S155, the process advances to a stepS161 so as to register the gamma correction curve CV_0 onto the registerRGST1. When YES is determined in the step S157, the process advances toa step S163 so as to register the gamma correction curve CV_1 onto theregister RGST1. When YES is determined in the step S159, the processadvances to a step S165 so as to register the gamma correction curveCV_2 onto the register RGST1. When NO is determined in the step S159,the process advances to a step S167 so as to register the gammacorrection curve CV_3 onto the register RGST1.

Upon completion of the process in the step S161, 5163, S165, or S167,the process advances to a step S169 so as to adjust the contrast of thedisplay image data accommodated in the display image area 32 b withreference to the gamma correction curve registered on the registerRGST1. Upon completion of the contrast adjustment, the processes in theabove-described steps S125 to S137 and S145 are executed. Thereafter,the process is restored to the routine at an upper hierarchical level.

The CPU 26 may optionally execute processes in steps S171 to S177 shownin FIG. 30, instead of the processes in the steps S151 to S159 shown inFIG. 28.

Firstly, in the step S171, an edge amount of the display image databelonging to the registration-frame-structure character RF1 is detectedas “EDG”. In the step S173, it is determined whether or not the edgeamount EDG exceeds a reference value E0. In the step S175, it isdetermined whether or not the edge amount EDG exceeds a reference valueE1. In the step S177, it is determined whether or not the edge amountEDG exceeds a reference value E2. It is noted that among the referencevalues E0 to E2, a relationship of E0>E1>E2 is established.

When YES is determined in the step S173, the process advances to thestep S161, when YES is determined in the step S175, the process advancesto the step S163, when YES is determined in the step S177, the processadvances to the step S165, and when NO is determined in the step S177,the process advances to the step S167.

Furthermore, the CPU 26 may optionally execute processes in steps S181to S193 shown in FIG. 31, instead of the processes in the steps S151 toS167 shown in FIG. 28.

Firstly, in the step S181, a variable N is set to “0”. In the step S183,the contrast of the display image data accommodated in the display imagearea 32 b is adjusted with reference to the gamma correction curve CV_N.In the step S185, the edge amount of one portion of the display imagedata belonging to the registration-frame-structure character RF1 isdetected as “EDG_N”.

In the step S187, the variable N is incremented. In the step S189, it isdetermined whether or not the variable N exceeds “3”. When a determinedresult is NO, the process returns to the step S183, and when thedetermined result is YES, the process advances to the step S191. In thestep S191, a maximum value is specified from among the edge amountsEDG_0 to EDG_3. In the step S193, the gamma correction curvecorresponding to the maximum value specified in the step S191 isregistered onto the register RGST1.

The CPU 26 may optionally execute processes in steps S201 to 5209 shownin FIG. 32, instead of the processes in the steps S151 to S167 shown inFIG. 28.

In the step S201, the graphic generator 46 is controlled so as todisplay an inquiry screen shown in FIG. 33 on the LCD monitor 38.According to FIG. 33, the inquiry screen has an inquiry message of “Isdesignated image black?” and items of “YES” and “NO”. In the step S203,it is determined whether or not the item of “YES” is selected by anoperator. In the step S205, it is determined whether or not the item of“NO” is selected by the operator. When a determined result in the stepS203 is YES, the process advances to the step S207 so as to register thegamma correction curve CV_0 onto the register RGST1. On the other hand,when the determined result in the step S205 is YES, the process advancesto the step S209 so as to register the gamma correction curve CV_3 ontothe register RGST1.

It is noted that in this embodiment, upon designation of the desiredobject image, the manipulations of the tele/wide button 28 tw, the crossbutton 28 cs, and the registration button 28 rg are required. However,instead of these button manipulations, touch manipulations on themonitor screen may be optionally required. Moreover, in this embodiment,the designating manipulation of the desired object image is accepted inthe reproduction mode; however, the designating manipulation of thedesired object image may also be optionally accepted in the camera mode.Furthermore, in this embodiment, a still camera which records a stillimage is assumed; however, it is also possible to apply the presentinvention to a movie camera which records a moving image.

Although the present invention has been described and illustrated indetail, it is clearly understood that the same is by way of illustrationand example only and is not to be taken by way of limitation, the spiritand scope of the present invention being limited only by the terms ofthe appended claims.

1. An image processing apparatus, comprising: a fetcher which fetches anobject scene image; a first adjuster which adjusts a tonality of theobject scene image fetched by said fetcher, corresponding to a propertyof a display device; an object-scene-image outputter which outputs theobject scene image having the tonality adjusted by said first adjuster,toward the display device; a second adjuster which adjusts the tonalityof the object scene image fetched by said fetcher, in parallel with theadjusting process of said first adjuster; and a first searcher whichsearches for an object image that coincides with a registered objectimage from the object scene image having the tonality adjusted by saidsecond adjuster.
 2. An image processing apparatus according to claim 1,further comprising a graphic image outputter which outputs a graphicimage directed at the object image discovered by said first searcher,toward the display device.
 3. An image processing apparatus according toclaim 1, wherein said object-scene-image outputter and said graphicimage outputter execute an output process in parallel to each other. 4.An image processing apparatus according to claim 1, further comprising:an accepter which accepts a designating manipulation for designating theobject image on the object scene image fetched by said fetcher; a secondsearcher which searches for a predetermined object image that coincideswith the object image designated by the designating manipulation fromamong a plurality of predetermined object images; and a definer whichdefines, as the registered object image, the predetermined object imagediscovered by said second searcher.
 5. An image processing apparatusaccording to claim 4, wherein the plurality of predetermined objectimages include a plurality of animal images respectively correspondingto a plurality of species and the designating manipulation is equivalentto a manipulation for designating an animal image.
 6. An imageprocessing apparatus according to claim 4, further comprising: a setterwhich sets the tonality of the object image designated by thedesignating manipulation to each of a plurality of tonalities differentfrom one another; and a first determiner which determines a parameterreferred to for the tonality adjustment of said second adjuster, basedon a searched result of said second searcher in which the object imagehaving the tonality set by said setter is noticed.
 7. An imageprocessing apparatus according to claim 4, further comprising: anattribute detector which detects an attribute of the object imagedesignated by said designator; and a second determiner which determinesa parameter referred to for the tonality adjustment of said secondadjuster, based on the attribute detected by said attribute detector. 8.An image processing apparatus according to claim 7, wherein theattribute includes a plurality of brightness respectively correspondingto a plurality of positions on the object image.
 9. An image processingapparatus according to claim 7, wherein the attribute includes an edgeamount of the object image.
 10. An image processing apparatus accordingto claim 7, wherein the attribute includes a color of the object image.11. An image processing apparatus according to claim 1, furthercomprising an imager which has an imaging surface on which an objectscene is captured and which produces an object scene image, wherein saidfetcher fetches the object scene image produced by said imager.
 12. Animage processing apparatus according to claim 11, further comprising animaging condition adjuster which adjusts an imaging condition bynoticing the object image discovered by said first searcher.